Bayesian learning for multi-agent coordination

Multi-agent systems draw together a number of significant trends in modern technology: ubiquity, decentralisation, openness, dynamism and uncertainty. As work in these fields develops, such systems face increasing challenges. Two particular challenges are decision making in uncertain and partially-observable environments, and coordination with other agents in such environments. Although uncertainty and coordination have been tackled as separate problems, formal models for an integrated approach are typically restricted to simple classes of problem and are not scalable to problems with tens of agents and millions of states.We improve on these approaches by extending a principled Bayesian model into more challenging domains, using Bayesian networks to visualise specific cases of the model and thus as an aid in deriving the update equations for the system. One approach which has been shown to scale well for networked offline problems uses finite state machines to model other agents. We used this insight to develop an approximate scalable algorithm applicable to our general model, in combination with adapting a number of existing approximation techniques, including state clustering.We examine the performance of this approximate algorithm on several cases of an urban rescue problem with respect to differing problem parameters. Specifically, we consider first scenarios where agents are aware of the complete situation, but are not certain about the behaviour of others; that is, our model with all elements but the actions observable. Secondly, we examine the more complex case where agents can see the actions of others, but cannot see the full state and thus are not sure about the beliefs of others. Finally, we look at the performance of the partially observable state model when the system is dynamic or open. We find that our best response algorithm consistently outperforms a handwritten strategy for the problem, more noticeably as the number of agents and the number of states involved in the problem increase

Acute: high-level programming language design for distributed computation

Existing languages provide good support for typeful programming of standalone programs. In a distributed system, however, there may be interaction between multiple instances of many distinct programs, sharing some (but not necessarily all) of their module structure, and with some instances rebuilt with new versions of certain modules as time goes on. In this paper we discuss programming language support for such systems, focussing on their typing and naming issues. We describe an experimental language, Acute, which extends an ML core to support distributed development, deployment, and execution, allowing type-safe interaction between separately-built programs. The main features are: (1) type-safe marshalling of arbitrary values; (2) type names that are generated (freshly and by hashing) to ensure that type equality tests suffice to protect the invariants of abstract types, across the entire distributed system; (3) expression-level names generated to ensure that name equality tests suffice for type-safety of associated values, e.g. values carried on named channels; (4) controlled dynamic rebinding of marshalled values to local resources; and (5) thunkification of threads and mutexes to support computation mobility. These features are a large part of what is needed for typeful distributed programming. They are a relatively lightweight extension of ML, should be efficiently implementable, and are expressive enough to enable a wide variety of distributed infrastructure layers to be written as simple library code above the byte-string network and persistent store APIs. This disentangles the language runtime from communication intricacies. This paper highlights the main design choices in Acute. It is supported by a full language definition (of typing, compilation, and operational semantics), by a prototype implementation, and by example distribution libraries

Acute: High-level programming language design for distributed computation : Design rationale and language definition

This paper studies key issues for distributed programming in high-level languages. We discuss the design space and describe an experimental language, Acute, which we have defined and implemented. Acute extends an OCaml core to support distributed development, deployment, and execution, allowing type-safe interaction between separately-built programs. It is expressive enough to enable a wide variety of distributed infrastructure layers to be written as simple library code above the byte-string network and persistent store APIs, disentangling the language runtime from communication. This requires a synthesis of novel and existing features: (1) type-safe marshalling of values between programs; (2) dynamic loading and controlled rebinding to local resources; (3) modules and abstract types with abstraction boundaries that are respected by interaction; (4) global names, generated either freshly or based on module hashes: at the type level, as runtime names for abstract types; and at the term level, as channel names and other interaction handles; (5) versions and version constraints, integrated with type identity; (6) local concurrency and thread thunkification; and (7) second-order polymorphism with a namecase construct. We deal with the interplay among these features and the core, and develop a semantic definition that tracks abstraction boundaries, global names, and hashes throughout compilation and execution, but which still admits an efficient implementation strategy

Home and Online Management and Evaluation of Blood Pressure (HOME BP) using a digital intervention in poorly controlled hypertension: randomised controlled trial

Objective: The HOME BP (Home and Online Management and Evaluation of Blood Pressure) trial aimed to test a digital intervention for hypertension management in primary care by combining self-monitoring of blood pressure with guided self-management. Design: Unmasked randomised controlled trial with automated ascertainment of primary endpoint. Setting: 76 general practices in the United Kingdom. Participants: 622 people with treated but poorly controlled hypertension (>140/90 mm Hg) and access to the internet. Interventions: Participants were randomised by using a minimisation algorithm to self-monitoring of blood pressure with a digital intervention (305 participants) or usual care (routine hypertension care, with appointments and drug changes made at the discretion of the general practitioner; 317 participants). The digital intervention provided feedback of blood pressure results to patients and professionals with optional lifestyle advice and motivational support. Target blood pressure for hypertension, diabetes, and people aged 80 or older followed UK national guidelines. Main outcome measures: The primary outcome was the difference in systolic blood pressure (mean of second and third readings) after one year, adjusted for baseline blood pressure, blood pressure target, age, and practice, with multiple imputation for missing values. Results: After one year, data were available from 552 participants (88.6%) with imputation for the remaining 70 participants (11.4%). Mean blood pressure dropped from 151.7/86.4 to 138.4/80.2 mm Hg in the intervention group and from 151.6/85.3 to 141.8/79.8 mm Hg in the usual care group, giving a mean difference in systolic blood pressure of −3.4 mm Hg (95% confidence interval −6.1 to −0.8 mm Hg) and a mean difference in diastolic blood pressure of −0.5 mm Hg (−1.9 to 0.9 mm Hg). Results were comparable in the complete case analysis and adverse effects were similar between groups. Within trial costs showed an incremental cost effectiveness ratio of £11 ($15, €12; 95% confidence interval £6 to £29) per mm Hg reduction. Conclusions: The HOME BP digital intervention for the management of hypertension by using self-monitored blood pressure led to better control of systolic blood pressure after one year than usual care, with low incremental costs. Implementation in primary care will require integration into clinical workflows and consideration of people who are digitally excluded. Trial registration: ISRCTN13790648

Home and Online Management and Evaluation of Blood Pressure (HOME BP) using a digital intervention in poorly controlled hypertension:Randomised controlled trial

Objective The HOME BP (Home and Online Management and Evaluation of Blood Pressure) trial aimed to test a digital intervention for hypertension management in primary care by combining self-monitoring of blood pressure with guided self-management. Design Unmasked randomised controlled trial with automated ascertainment of primary endpoint. Setting 76 general practices in the United Kingdom. Participants 622 people with treated but poorly controlled hypertension (&gt;140/90 mm Hg) and access to the internet. Interventions Participants were randomised by using a minimisation algorithm to self-monitoring of blood pressure with a digital intervention (305 participants) or usual care (routine hypertension care, with appointments and drug changes made at the discretion of the general practitioner; 317 participants). The digital intervention provided feedback of blood pressure results to patients and professionals with optional lifestyle advice and motivational support. Target blood pressure for hypertension, diabetes, and people aged 80 or older followed UK national guidelines. Main outcome measures The primary outcome was the difference in systolic blood pressure (mean of second and third readings) after one year, adjusted for baseline blood pressure, blood pressure target, age, and practice, with multiple imputation for missing values. Results After one year, data were available from 552 participants (88.6%) with imputation for the remaining 70 participants (11.4%). Mean blood pressure dropped from 151.7/86.4 to 138.4/80.2 mm Hg in the intervention group and from 151.6/85.3 to 141.8/79.8 mm Hg in the usual care group, giving a mean difference in systolic blood pressure of -3.4 mm Hg (95% confidence interval -6.1 to -0.8 mm Hg) and a mean difference in diastolic blood pressure of -0.5 mm Hg (-1.9 to 0.9 mm Hg). Results were comparable in the complete case analysis and adverse effects were similar between groups. Within trial costs showed an incremental cost effectiveness ratio of £11 ($15, €12; 95% confidence interval £6 to £29) per mm Hg reduction. Conclusions The HOME BP digital intervention for the management of hypertension by using self-monitored blood pressure led to better control of systolic blood pressure after one year than usual care, with low incremental costs. Implementation in primary care will require integration into clinical workflows and consideration of people who are digitally excluded. Trial registration ISRCTN13790648.</p

The Effects of Multiple Dimensions of Risk and Protective Factors on Depressive Symptoms Among Nonresident African American Fathers

Compared to other groups, African American men experience proportionately greater adverse social and economic circumstances, which have been linked to poor mental health. A growing body of literature has begun to examine depressive symptoms among African American men; however, limited literature has examined the concurrent contributions of risk and protective factors among nonresident African American fathers. This study examined the relative contribution of perceived financial strain, perceived neighborhood characteristics, and interpersonal stress on depressive symptoms among 347 nonresident African American fathers. Social support was examined as a protective factor for depressive symptoms. Results from hierarchical regression analyses indicated interpersonal stress was associated with depressive symptoms even after controlling for perceived financial strain, perceived neighborhood characteristics, and specific sociodemographic factors. Additionally, among fathers with high interpersonal stress, having more social support buffered the negative effect of interpersonal stress on depressive symptoms. Findings suggest experiencing strain from multiple dimensions can increase the risk of depressive symptoms among nonresident African American fathers. We also found that interpersonal stress was especially harmful for mental health. Family service providers and mental health professionals should incorporate stress management techniques to reduce stressful interpersonal relationships as a way to lower depressive symptoms among nonresident African American fathers.HighlightsMultiple risk factors influence depressive symptoms for nonresident African American fathers.Interpersonal stressors are especially harmful for their mental health.Interpersonal stress management techniques should be considered for reducing depressive symptoms.Peer Reviewedhttps://deepblue.lib.umich.edu/bitstream/2027.42/146878/1/ajcp12275_am.pdfhttps://deepblue.lib.umich.edu/bitstream/2027.42/146878/2/ajcp12275.pd

Symmetry and the generation and measurement of optical torque

A key element in the generation of optical torque in optical traps, which occurs when electromagnetic angular momentum is transferred from the trapping beam to the trapped particle by scattering, is the symmetries of the scattering particle and the trapping beam. We discuss the effect of such symmetries on the generation and measurement of optical torque in optical tweezers, and some consequent general principles for the design of optically-driven micromachines.Comment: 28 page

Covariant Lagrange multiplier constrained higher derivative gravity with scalar projectors

We formulate higher derivative gravity with Lagrange multiplier constraint and scalar projectors. Its gauge-fixed formulation as well as vector fields formulation is developed and corresponding spontaneous Lorentz symmetry breaking is investigated. We show that the only propagating mode is higher derivative graviton while scalar and vector modes do not propagate. Despite to higher derivatives structure of the action, its first FRW equation is the first order differential equation which admits the inflationary universe solution.Comment: Physics Letters B published version. LaTeX 12 page

Fingerprinting coal-derived gases from the UK

The large-scale extraction of unconventional hydrocarbons in the United States has led to fears of methane contamination of shallow groundwaters. Differentiating between the deep gas released during extraction (shale gas, coal bed methane and underground coal gasification) and natural shallow-sourced methane is imperative for the monitoring and managing of environmental risks related to the extraction process. Here, for the first time, we present measurements of the major gas, and stable and noble gas isotope composition of coal bed methane (CBM) from central Scotland and coal mine methane (CMM) from central England, UK. The molecular (C1/(C2+C3) = 21 to 120) and stable isotope compositions (δ13CCH4 = -39.5 to -51.1‰; δDCH4 = -163 to -238‰) indicate a thermogenic origin for the methane. They are distinct from the majority of shallow-sourced gases in UK. Both sample suites exhibit high He concentrations (338 to 2980 ppmv) that are considerably above atmospheric and groundwater levels. Simple modelling shows that these high 4He concentrations cannot be solely derived from in situ production since coal deposition, and hence the majority is derived from the surrounding crust. The Scottish CBM contains a resolvable mantle He, Ne and Ar contribution that may originate from melts in the deep crust, demonstrating the UK coals have acted as a store for deep volatiles for 10s of millions of years. The high 4He in the coal-derived gases has the potential to be used as a novel diagnostic fingerprint to track fugitive release of deep methane from future unconventional gas extraction operations in the UK

Effects of 'pre-fracking' operations on ambient air quality at a shale gas exploration site in rural North Yorkshire, England

Rural observations of air quality and meteorological parameters (NOx, O3, NMHCs, SO2, PM) were made over a 2.5-year period (2016-2018) before, during and after preparations for hydraulic fracturing (fracking) at a shale gas exploration site near Kirby Misperton, North Yorkshire, England. As one of the first sites to apply for permits to carry out hydraulic fracturing, it has been subject to extensive regulatory and public scrutiny, as well as the focus for a major programme of long-term environmental monitoring. A baseline period of air quality monitoring (starting 2016) established the annual climatology of atmospheric composition against which a 20-week period of intensive activity on the site in preparation for hydraulic fracturing could be compared. During this 'pre-operational phase' of work in late 2017, the most significant effect was an increase in ambient NO (3-fold) and NOx (2-fold), arising from a combination of increased vehicle activity and operation of equipment on site. Although ambient NOx increased, air quality limit values for NO2 were not exceeded, even close to the well-site. Local ozone concentrations during the pre-operational period were slightly lower than the baseline phase due to titration with primary emitted NO. The activity on site did not lead to significant changes in airborne particulate matter or non-methane hydrocarbons. Hydraulic fracturing of the well did not subsequently take place and the on-site equipment was decommissioned and removed. Air quality parameters then returned to the original (baseline) climatological conditions. This work highlights the need to characterise the full annual climatology of air quality parameters against which short-term local activity changes can be compared. Based on this study, changes to ambient NOx appear to be the most significant air quality ahead of hydraulic fracturing. However, in rural locations, concentrations at individual sites are expected to be below ambient air quality limit thresholds